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ABSTRACT ARTICLE HISTORY 

Since the outbreak of COVID-19, wearing a mask, voluntary or obligatory, has Received 15 February 2021 

led to diverse and numerous designs. Guidelines for minimum requirements Accepted 30 June 2021 

include tests for visual inspection, strength, filtration, and breathing 

resistance, but not for the fit of a mask. The fit of a mask was assessed by Nec COVE : A 
3 5 see asks; COVID-19; aerosols; 

testing the outward leakage of exhaled breath based on the visualization SARS-CoV-2; outward 

of coloured mist exhaled by a manikin head. Fourteen masks were selected leakage 

based on differences in design, such as type of material, shape (cheek 

wings vs. none), filter type, and the number of layers. Leakage expressed in 

mean mist percentages (visualized with a camera), patterns of coloured 

mist left inside the masks, as well as visual fit of the masks on the manikin 

head, showed that a loose fit mask results in more leakage. Also, 

combining quantitative with qualitative assessment proved to be 

complementary. Future tests should be conducted on a range of users, 

covering the best fit over time as well breathability, use, and comfort. The 

use of face masks, whatever their characteristics, seem an adequate 

strategy to reduce the dispersion of potential ‘infected’ aerosols into the 

space from people, as opposed to not wearing one. 


Introduction 


What is needed to minimize the transmission of severe acute respiratory syndrome coronavirus 2 (SARS- 
CoV-2) has been questioned since the first outbreaks of COVID-19. SARS-CoV-2 can be transmitted in 
three ways: (1) directly (through virus-carrying droplets) when in close vicinity by coughing, sneezing, 
or talking (Chen et al. 2020); (2) indirectly via deposited or transmitted infectious droplets via surfaces; 
and (3) can be transmitted through virus-carrying small airborne droplets (also named ‘aerosols’) emitted 
by infected individuals, a transmission route for which evidence is increasing (Prather et al. 2020; Allen and 
Marr 2020; Asadi et al. 2020; Morawska et al. 2020). To reduce direct transmission from mainly large infec- 
tious droplets, the physical distancing of individuals has been adopted. For indirect transmission cleaning 
surfaces, washing hands, and sneezing/coughing in the elbow are advised. For airborne transmission, it has 
been recommended (e.g. (Morawska et al. 2020), (REHVA 2020), (ASHRAE 2020)): (a) to provide sufficient 
and effective ventilation (that supplies clean outdoor air and minimizes recirculating air); and (b) to sup- 
plement general ventilation with airborne infection controls such as local exhaust, high-efficiency air 
filtration (Bluyssen, Ortiz, and Zhang 2021), and/or germicidal ultraviolet lights in ventilation systems 
(Martin et al. 2008). The early adoption of universal face masks by all the public, even when asymptomatic, 
in certain Southeast Asian countries may have played a role in the effectiveness of such countries to diminish 
the spread of the virus and the death count (Su et al. 2020; Lim et al. 2020). This is supported by the fact that 
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universal mask wearing can also be effective for lowering the spread of the virus, also amongst asymptomatic 
wearers (Leung et al. 2020). For people who need to or tend to come close to (possible) infected persons, 
personal protective equipment is used (e.g. facial masks, protective gloves, respirators). Additionally, face 
mask or other types of face coverings are used by the public, whether mandatory or not, to prevent spread- 
ing (direct and/or airborne transmission) of the virus to others (MacIntyre and Chughtai 2020; Tcharkhtchi 
et al. 2021). 

The use of face masks by the public since the outbreak of COVID-19 has led to diverse and numerous 
designs, but also critical questions about whether mask use reduces the compliance with other rec- 
ommended strategies, such as physical distancing; or about whether wearing a mask protects the wearer 
from becoming infected themselves; and most importantly which criteria should a public mask fulfil to 
indeed the prevent spread of the virus to others (Howard et al. 2021). Chu et al. (2020) reviewed interven- 
tions against SARS-CoV-2 as well as against SARS and MERS (Middle East Respiratory Syndrome) and 
found that the use of masks could result in a reduction of the risk of infection (Chu et al. 2020). Widespread 
mask-wearing seems to lower the incidence of COVID-19 (Chu et al. 2020; Van Dyke et al. 2020; Mitze et al. 
2020) although a causal relationship has not been confirmed. The incidence of COVID-19 in Kansas coun- 
ties where the wearing of masks in public spaces was mandated, decreased after this mandate, while in Kan- 
sas counties without mask mandates the incidence continued to increase (Van Dyke et al. 2020). Also, in 
Germany after wearing face masks became mandatory in public transport and shops, the number of 
newly registered COVID-19 infections seems to have reduced (Mitze et al. 2020). 

The virus SARS-CoV-2 has a size of around 100 nm (0.1 um) in diameter and is surrounded by or 
embedded in a fluid comprising mainly of water. When a person exhales, talks, or sneezes, a range of dro- 
plets, from very small and airborne (aerosols) to larger and heavier ones, are brought into the air (Morawska 
et al. 2009). These expiratory droplets have the physical properties of viscoelastic fluids, and hence do not 
behave as a Newtonian fluid, however, their airborne behaviour is similar to that of a gas (Bhat et al. 2010; Ai 
and Melikov 2018; Chao, Wan, and Sze To 2008). The viral load contained in a droplet, and the amount 
needed to be infected and develop COVID-19 is still being studied (Buonanno, Morawska, and Stabile 
2020). Studies on the effects of masks on the flow of coughs have shown that surgical masks redirect the 
cough backward, while N95 reduced the speed of the jets (Tang et al. 2009), however, the degree to 
which a mask traps the aerosols is not known yet 

Guidelines for minimum requirements, methods of testing, and use of public masks have been intro- 
duced all over the world and are updated regularly (e.g. (WHO 2020; AFNOR 2020; NEN 2020; CDC 
2020; CEN 2020; NSAI 2020)). It is emphasized that these masks for public use are to protect others, not 
the wearer. With proper use of the mask, the risk of spreading droplets from the mouth and nose to the 
environment should be decreased. These guidelines comprise of recommendations for material use (should 
not contain chemicals that can harm health), the comfort of wearing, fit to face (contact surface as large as 
possible; minimum outward leakage), etc. Tests are described for visual inspection, strength, filtration, and 
breathing resistance. However, for outward leakage, no test has been defined (yet). 

Mask filtration studies have focused on filtration tests of different types of masks, using a standard 
mix of particles or based on particle emission by mask-wearers, usually without considering the fit 
(the potential outward leakage caused by ‘bad’ fit) (Asadi et al. 2020; Fischer et al. 2020; Akhtar 
et al. 2020). The filtration efficiency of a mask is represented by the capacity of holding particles and 
viruses in the air, specified with an efficiency ratio including particle size, filtrated air quantity, and 
wearing time (Tcharkhtchi et al. 2021). In a recent study performed by Pan et al. (2021), three tests 
to assess the effectiveness of several face coverings were performed by monitoring the concentration 
of particles: the material filtration efficiency, the inward protection efficiency, and the outward protection 
efficiency on a manikin. The tests indicated that the fit of the mask was important. Similarly, Konda 
et al. (2020) found that leakages can decrease the performance of a mask: improper fit of the mask 
(gaps) resulted in over a 60% decrease in the overall mask’s efficiency. 

More recently, the CDC has proposed that double masking, is a viable alternative to improve the fit and 
reduce the number of exhaled particles. A study suggested that combining a cloth mask with a medical pro- 
cedure mask can decrease the number of particles expelled from simulated coughs (Brooks et al. 2021). 
Other studies have assessed the performance of different materials for effective homemade masks: it was 
suggested that several materials and combinations thereof can be used to make a homemade mask that 
can meet several standards, including those for pressure differences, particle filtration efficiency, and resist- 
ance to wetting (Wang et al. 2020). Another study suggested that most fitted face mask alternatives, other 
than N95, will provide less filtration of the required >95%, except for expired N95 respirators or used and 
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sterilized ones (Sickbert-Bennett et al. 2020). A study performed to assess the efficacy of surgical masks to 
contain aerosols containing the coronavirus and the influenza virus, suggested that, when categorizing aero- 
sols as particles of less than 5 microns, surgical masks can diminish the dispersal of respiratory droplets into 
the environment but not of aerosols (Leung et al. 2020). 

Next to monitoring the number of particles that are filtrated, visualization of air leakage can be used. A 
study visualizing the leakage by using schlieren imaging concluded that jets from coughs when wearing a 
surgical mask are leaked through the sides, but with lower momentum. While wearing an N95 respirator 
will reduce the leak through the perimeter seal, however, the jet will penetrate through the mask material, 
at a lower velocity (Tang et al. 2009). For the visualization of aerosols and/or droplets, recently most studies 
have used airflow measurements or local measurements such as laser visualization of sprays and coughing, 
of which some in combination with a smoke or soap bubble generator and a manikin head (e.g. (Bluyssen, 
Ortiz, and Zhang 2021); (Morawska et al. 2009); (Verma, Dhanak, and Frankenfield 2020b); (Wolfel et al. 
2020); (Stadnytskyi et al. 2020); (Verma, Dhanak, and Frankenfield 2020a)). 

This study aimed at assessing the fit of a range of face masks by testing the outward leakage of exhaled 
breath based on the visualization of coloured mist exhaled by a manikin head. Therefore, it is worth highlight- 
ing the fact that this study does not focus on filtration efficiency. Several commercially available and masks and 
respirators were selected based on differences in design, such as type of material, shape (cheek wings vs. none), 
filter type, and the number of layers, while a respirator and a surgical mask were also selected. 


Methods 
Study design 


Water mist coloured with a fluorescent tracking fluid (Liqui Moly)was generated with the use of ultrasonic 
vibrations and introduced with a simulated human breathing system through a manikin head in the Experi- 
ence room of the SenseLab in Delft (Bluyssen et al. 2018) (see Figures 1-4). The manikin head was covered 
with different nose-mouth masks. The apparatus simulated the exhaling of an infected person, while the 
outward leakage of the coloured water mist was monitored by a camera at two different positions for differ- 
ent masks. The ventilation rate and the air temperature in the Experience room were kept constant at 
1200 m*/h (mixing ventilation) and 22°C, respectively. 


Experimental set-up 


An extruded polystyrene foam manikin adult (Figure 5) head was placed at position A on one of the tables in 
the Experience room (Figures 1 and 3a). The head was carved to create a comparative volume of an adult’s 


styrofoam 
head 


breathing 
machine 


PVC-tube 


ultrasonic 
mist maker 


Figure 1. Section from the set-up to produce coloured mist through a manikin head. 
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| 


Figure 2. Set-up of the manikin head with mask in the experience room. 


head and to create a connection between the neck of the head and the nostrils. The nostrils were made by 
drilling two 10 mm orifices connecting the larger tube. Based on earlier studies regarding nostril opening, a 
size of 10 mm diameter was chosen (Yi and Yoon 2016). 

A mechanical breathing system (ventilator designed by the project Inspiration of the TU Delft: https:// 
www.projectinspiration.nl/specification/), placed outside of the Experience room, provided air via a 5-metre 
long PVC-tube with an external diameter of 48 mm (Figure 3b) - the tube went through a 50 mm hole into 
the Experience room - and to the other side to a PVC-cylinder with the manikin head on top. In this box, 
water mist was generated and built up with an ultrasonic mist maker (Ueetek ultrasonic fogger mist maker) 
via ultrasonic vibrations. The water was mixed with fluorescent tracking liquid with a ratio of one part of the 
tracking liquid to 9 parts of distilled water. This ratio was chosen because if the ratio is higher, the mist 
maker won’t produce enough mist, and if it is lower the mist is not completely fluorescent. The non- 
dyed mist produced with this method has a particle size in the range of 3-7 um; however, it is not 
known whether the addition of dye changes this parameter. 

The breathing machine provided circa 0.5 L (not inhaling, only exhaling) in 1.25 s, resulting in a breath- 
ing cycle of 2.5 s (24 exhalations per minute, similar to moderate physical activity). Normal breathing lies 
around 15 times per minute (4 s per breathing cycle) and one breath of air amounts to approximately 0.5 L 
(Barrett et al. 2019). 


(a) 


Figure 3. (a) Manikin head on a box with an ultrasonic mist maker. (b) Breathing machine outside the Experience room. 
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Figure 4. Experimental set-up for the two positions of the camera: (A) in front of the manikin head; (B) on the side of the manikin 
head. 


Surrounding the set-up, six UV-lights were positioned to highlight the exhaled mist (Figures 1 and 4). To 
minimize the reflection of light by background objects (mostly walls and desks), surfaces were covered with 
black paper or foil. Additionally, all lights inside the SenseLab were turned off, and windows were covered, 
to have the least possible false light coming into the Experience room. 

A camera (GoPro HERO 8 Black) was installed at a tri-pod and used to acquire images (one picture every 
two seconds with a wide-angle - 130 degrees), either in front of the manikin head or on the side (see Figure 
4). The camera was placed 1.5 metres away from the head, both for the front and side recordings, covering 
an area of 4 x 3.26 m’. 
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Figure 5. Extruded polystyrene foam adult head. 


Test scheme and procedure 


Fourteen different masks were selected based on differences in characteristics, namely: number of layers, 
filter type, presence of fenders, and nose piece type. These characteristics were chosen as these are the 
ones that vary most amongst masks offered in the market from which consumers can choose. Additionally, 
for woven masks, the number of threads per square centimetres was also used. this was done by drawing a 
square of one centimetre by one centimetre on the fabric of the mask, taking a high-quality zoom picture, 
and counting the number of threads vertically and horizontally. 

In Table 1, the characteristics of the selected masks are presented. Codes were given to the masks to 
maintain their anonymity. Letters A through N were used to give individuality of the mask, and numbers 
indicated their precedence, mainly 1: medical masks; 2: commercial masks from a pharmacy; 3: homemade 
masks according to governmental guidelines; 4-7: specific brand. 

Each mask was tested twice for both positions of the camera, for two minutes (visual steady state leakage 
was reached after 90 s). Additionally, a test was performed without any mask (also twice). The protocol was 
as follows: 


e Experience room and general space lights off. UV-lights on. 

e Put mask on the manikin head. 

e Plug in the mist maker. 

e Let mist build up for 1 min 

e Turn on the camera (GoPro) and the lung. 

e Count 2 min of lung running and the camera taking pictures after the lung and the camera are turned on. 
Researchers stay outside the room 

e After 2 min, one researcher goes in, to record exhalations with a cell phone and yellow filter. 

e After recording, turn off the lung and the camera, unplug the mist maker and remove the mask. 

e Repeat step one with the next mask. 


The production of mist remained constant during the two minutes, as did the breathing rate. After 
the first run of experiments and the last, a picture of the interior of the masks was taken to record the 
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Table 1. Selected masks to be tested on the outward leakage. 


Inner Filter Nose Piece 
Code Material Layers Layer Thread / cm? type Fenders Size particle type 
Al outer: acrylic bond inner: extra 3 - non-woven no PMo3 - 55- inside wire 
fine glass fibre 90% 
B1 electrostatic polypropylene 4 = non-woven KN95 no PMo3 -95% inside wire 
C2 polyester 100% 2 2 woven: 14x14 a no = none 
D2 cotton 100% 3 woven: 42x42 a yes = inside wire 
outer; 34x34 
inner 
E3 cotton 100% 12 = woven: 11x20 - no - none 
F4 out: polyester spun bond; in: 3 1 non-woven KN95 yes PMo3 -95% silicone 
electrostatic synthetic fibres 
G5 electrostatic polypropylene 6 4 outer: Inner: non- yes silicone 
woven perimeter 
H6 electrostatic polypropylene 6 4 outer: Inner: non- yes silicone 
woven perimeter 
17 electrostatic polypropylene 4 < non-woven KN95 no PMo3 -95% foam 
J3 100% cotton old bedsheets 2 - woven: 21*21 - no - none 
K3 100% cotton in and out 2 - woven: 58x58 - no - inside wire 
outer; 67x67 
inner 
L2 100% polyester + filter 3 1 woven: 32x32 PM25 no PM25<95% none 
inner and outer 
M2 100% polyester 1 - woven: 29x29 no = none 
N2 50% bamboo, 50% polyamide 2 = woven: 17x17 - no - inside wire 


inner and outer 


pattern the mist takes to exit the perimeter seal of the masks. Additionally, the dimensions of each mask 
were measured. 


Data management and analysis 


A four-step process was performed to manage and analyse the resulting images. First, the images were pro- 
cessed with FFmpeg, an image processing open-source software. Specifically, background subtraction was 
performed with the full sequence of images (see Figures 6a and b). The method is a technique that detects 
moving elements between each consecutive image in the sequence in a static frame. As a result, the final 
footage only highlights the moving elements, which represent the mist escaped from the masks. 

Secondly, the resulted sequence of images, without background were processed with Image Colour Sum- 
marizer v.0.77. The software creates descriptive statistics related to the colours of the image. Specifically, it 
clusters the colours of the image and provides a percentage of each colour. In this case, clustering was per- 
formed for two colours, that of the subtracted background and that of the mist. Mist percentages were cal- 
culated for each image taken every 10s of the two minutes breathing experiment. Additionally, mist 
percentages were drawn for images between the 40th and 90th seconds. 


(b) 


Figure 6. (a) Frame from the front view. (b) Frame from the side view. 
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Finally, the mean mist percentage and the sum of mist percentages for each mask were calculated for each 
run, based on the images between 40th and 90th second. To compare mist percentages for the different 
masks, the two runs per position, and for the different positions of the camera, independent t-testing 
and one-way ANOVA were used with SPSS version 26. The one-way ANOVA tests were performed on 
the means from the front leakage and the side leakage, to determine whether statistically significant differ- 
ences existed between the percentage of mist leakage from masks between the 40th second and the 90th 
second of the experiments. The t-tests were performed to determine whether the means of the two tests 
in both test series for each mask could be considered to be the same. Logistic regression was also performed 
to examine possible associations between the mask variables with the masks’ performance ranking. 
Additionally, qualitative descriptions of the mist distribution as well as the pattern of mist left behind inside 
the masks were made. 


Results 
Outward leakage 


Figure 7 presents the percentage of mist over the full experiment for every 10 s. A graph was produced for 
each mask with the camera on the side of the manikin head (two times) and for each mask with the camera 
on the front of the manikin head (two times). Appendix A presents the pictures and the percentage of mist 
for images taken at second 40; 50; 60; 70; 80 and 90 for each mask tested on the side (twice) and in front 
(twice). 


Pattern of mist in mask interior 


The images taken from the patterns of mist deposited/filtered by the masks are presented in Figure 8. A 
picture of each mask while on the manikin’s head together with the dimensions of the masks and a descrip- 
tion of their fit can be found in Figure 9. 


Statistical analysis 


The means of the two tests performed for each mask in the period from the 40thto the 90th second were 
calculated for both the front and side test series. Figure 10 shows the mean percentage of mist for pictures 
taken between the 40th and the 90th second, for each mask tested on the side and in front (twice). Addition- 
ally, a qualitative description of the mist distribution is presented for the side and front tests, per mask. The 
results presented in Table 2, for both the front and side test series, show that except for 4 cases in the front 
series (D2, E3, F4, and N2) and 3 cases in the side series (B1, D2, and K3), the means of the two runs can be 
considered the same. 

The results of the one-way ANOVA tests indicate statistical differences for all four series of tests and also 
for the means of both the front and the side tests. Then, the performance ranking of the masks was per- 
formed based on the mean values of the two series of tests (see Table 2). 

T-testing was performed to determine whether the differences between the mean percentages of the mist 
of the masks were statistically different from each other for the front and the side series (Table 3). Based on 
the outcome, a new leakage performance ranking of masks was performed (Table 4). Logistic regression was 
performed to examine possible associations between the mask variables with the masks’ performance rank- 
ing (Table 5). 


Discussion 
Quantitative comparison 


Outward leakage of different masks 
The mean outward leakage expressed in a percentage of mist varied from 3.9% (SD=0.4) to 20.0% 
(SD=4.5) in the front series, while in the side series from 3.8% (SD=0.5) to 25.4% (SD=1.2). 
The tests without masks resulted in respectively 36.7% (SD=1.3) and 6.4% (SD=1.0) for front and 
side tests. 

The ranking of the mean outward leakage expressed in a percentage of mist was performed for both 
series of tests, which is shown in the last column of Table 2 for both the front series and the side series. 
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Figure 7. The percentage of mist over the full experiment for every 10 s an image per mask with the camera on the side of the 


manikin head (two times) and with the camera in front of the manikin head (two times). 
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Figure 8. Fluorescence colouring inside the masks after the first and last series of tests, including a qualitative assessment of the 
colouring pattern. 
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Figure 9. Tested masks on manikin head, dimensions and fit. 


To determine whether this ranking was statistically relevant, t-testing was performed in which the mean 
outward leakage expressed in a percentage of mist between masks, was compared for the in front and 
the side series (Table 3). 
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Figure 10. Qualitative description of the visualization of the mean percentage of mist for pictures taken between the 40th and the 
90th second, for each mask tested on the side (twice) and in front (twice). 
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Table 2. Means of percentages, sums (40-90 s) and t-tests. 


mask mean 1 (SD) mean 2 (SD) t-teStmeant-2 (P)? mean;-2 (SD) Mean.um (SD) Leakage ranking 
in front series 

Al 12.4 (1.6) 8.4 (1.6 4.5 (0.0012) 10.5 (1.5) 62.8 (17.1) 4 
B1 9.7 (0.4) 11.6 (1.8 —2.4 (0.0503) 10.6 (1.0) 63.7 (8.0) 5 
C2 20.8 (5.2) 19.3 (3.9 0.5 (0.6071) 20.0 (4.5) 120.3 (6.0) 14 
D2 9.0 (1.4) 12.5 (0.6 —5.6 (0.0008) 10.8 (0.8) 64.6 (14.6) 6 
E3 4.6 (0.5) 3.2 (0.4 5.7 (0.0003) 3.9 (0.4) 23.4 (6.0) 1 
F4 9.8 (0.6) 7.0 (1.5 4.3 (00035) 8.4 (1.0) 50.1 (11.9) 2 
G5 19.8 (4.7) 12.9 (3.9 2.8 (0.0197) 16.4 (4.2) 98.1 (29.2) 12 
H6 15.3 (2.8) 13.2 (2.6 1.4 (0.2047) 14.3 (2.7) 85.5 (8.9) 8 
17 16.9 (1.1) 14.2 (1.9 2.9 (0.0191) 15.6 (1.3) 93.3 (11.4) 10 
J3 15.9 (2.1) 13.7 (1.9 1.9 (0.0938) 14.8 (1.9) 88.6 (9.2) 9 
K3 11.6 (2.0) 14.8 (0.8 —3.7 (0.0102) 13.2 (1.2) 79.1 (13.8) 7 
L2 9.8 (1.3) 9.6 (0.6 0.5 (0.6234) 9.7 (1.0) 58.3 (1.3) 3 
M2 20.4 (3.7) 19.5 (4.1 0.4 (0.6953) 20.0 (3.8) 119.8 (3.9) 13 
N2 13.9 (2.0) 18.1 (1.6 —4.0 (0.0030) 16.0 (1.4) 95.6 (17.7) 11 
FP 21.8 (0.000) 24.6 (0.000) 26.5 (0.000) 22.9 (0.000) 

none 40.8 (4.1) 32.6 (3.3 —14.4 (0.005) 36.7 (1.3) 119.8 (3.9) 

on side series 

Al 22.7 (3.6) 22.0 (2.8 0.3 (0.7454) 22.4 (2.9) 134.1 (2.6) 12 
B1 13.2 (1.5) 18.3 (1.1 —6.7 (0.0001) 15.7 (1.2) 94.4 (21.9) 6 
C2 24.8 (4.9) 26.0 (4.8 —0.4 (0.6772) 25.4 (1.2) 152.4 (5.1) 14 
D2 ee (1.9) 21.5 (2.9 —5.0 (0.0008) 18.0 (2.3 107.8 (30.1) 7 
E3 2 (0.6) 4.4 (1.0 —2.4 (0.0463) 3.8 (0.5 22.8 (4.8) 1 
F4 i 8 (1.9) 13.2 (2.1) 0.5 (0.6032) 13.5 (1.8 81.0 (2.6) 4 
G5 16.4 (1.4) 22.5 (4.6) —3.1 (0.0207) 19.5 (2.5 116.8 (26.0) 10 
H6 17.7 (1.5) 18.6 (1.6) —1.1 (0.3189) 18.2 (0.8 108.9 (3.9) 8 
17 17.0 (1.7) 13.2 (2.1) 5.4 (0.0029) 15.1 (0.9 90.6 (16.2) 5 
J3 23.9 (1.9) 18.6 (6.2) 2.0 (0.0910) 21.2 (3.3 127.4 (22.7) 11 
K3 z 9 (0.9) 15.7 (1.5) —6.6 (0.0002) 13.3 (1.0 79.9 (20.4) 3 
L2 3 (0.5) 11.6 (1.3) —4.1 (0.0062) 10.4 (0.6 62.6 (9.7) 2 
M2 n (3.3) 20.4 (3.0) —1.8 (0.1072) 18.8 (3.1 112.5 (13.6) 9 
N2 20.0 (0.8) 25.8 (5.1) —2.8 (0.0387) 22.9 (2.5 137.2 (24.6) 13 
FP p 8 (0.000) 20.0 (0.000) 47.7 (0.000) 47.7 (0.000) 

none 3 (0.7) 8.6 (1.4) 2.9 (0.017) 6.4 (1.0) 38.6 (18.2) 


aa negative value for the t-test means that the percentage of mist for the second series was less than for the first series. p is bold 
means statistically relevant difference for the two means with p < 0.001. °F-value from one-way ANOVA test. 


For both the front and the side series, mask E3 performed the best, with the lowest outward leakage 
(respectively 3.9% (SD=0.4) and 3.8% (SD=0.5)). The worst performing mask in both series, mask C2 
(respectively 20.0% (SD=4.5) and 25.4% (SD=1.2)), did not differ statistically with mask M2 (20.0% 
(SD=3.8)) in the front series, and with mask N2 of the side series (22.9% (SD=2.5)). 

Additionally, in the front series, masks F4 and L2; as well as masks Al, B1 and D2; masks H6, J3 and 17; 
and masks N2 and G5, showed no statistical difference in mean values. In the side series, masks K3 and F4; 
masks I7 and B1; masks D2, H6, M2 and G5; and masks J3 and A showed no statistical difference in mean 
values. 

Compared to ‘no mask’, only mask E3 is better performing in the side evaluation, while for the in-front 
evaluation, all masks are better than no mask. This outcome indicates that wearing a mask prevents exhaled 
breath to move in front, but can move the ‘aerosols’ to the side, back, down, and up, depending on the 
design of the mask. 


Outward leakage and design variables 
From the logistic regression, only the variable of fit (loose vs tight) showed to have a statistically significant 
association between masks ranked in the top half and the number of layers. Specifically, it shows what can be 
confirmed qualitatively, that a tight fit plays an important role in the good performance of the mask. In this 
study, only one of the top six ranked masks presented a loose fit (in the side test series). 

In terms of fit test, according to AFNOR (AFNOR 2020), NEN (NEN 2020), and CEN (CEN 2020), con- 
sumers need to pay attention to the fit of the mask in their own face, by making sure that all the perimeter of 
the mask is in contact with the skin, leaving no gaps between. 


Table 3. Comparison of percentage mist between different masks with t-test for in front and on side series. 


in front series 


mask E3 F4 L2 A1 B1 D2 K3 H6 J3 17 N2 G5 M2 
F4 —10.3* - 
L2 —15.9* —1.8 (0.11) - 
A1 —9.7* —2.8* —1.7 (0.13) - 
B1 —16.1* —3.3* —1.9 (0.08) 0.5 (0.63) - 
D2 —24.7* —4.0* —2.6* 0.5 (0.65) —0.1 (0.92) - 
K3 —18.8 (0.1) —7.0* —6.2* —2.5* —4.2* —4.8* - 
H6 —9.7* —5.2* —4.6* —3.0* —3.7 (0.01) —3.8* —1.5 (0.18) - 
J3 —13.0* —6.9* —6.2* —3.8* —4.0* —5.2* —2.2 (0.06) —0.3 (0.80) - 
17 —22.8* —10.8 (0.11) —10.4* —5.5* —8.3 (0.1) —9,5* —4,0* —0.7 (0.48) —0.5 (0.61) - 
N2 —17.2* —8.8 (0.82) —8.2* —4.8* —6.6* —7.2* —3.1* —0.6 (0.59) —0.3 (0.75) 0.2 (0.84) - 
G5 —7.1* —4.5* —4.1* —3.2* —3.6* —3.6* —2.3 (0.06) —1.2 (0.26) —1.1 (0.31)  —0.9 (0.40) —1.0 (0.37) - 
M2 —13.3* —9.1 (0.62) —8,59* —6.8* —7.8* —7.9* —5.7* —3.5* —3.6* —3.7* —3.6* —1.4 (0.20) - 
C2 —10.2* —7.2* —6.7* —5.5* —6.1* —6.2* —4.6* —3.0* —3.1* —3.0* —3.0* —1.3 (0.21) —0.1 (0.89) 
on side series 
E3 L2 K3 F4 17 B1 D2 H6 M2 G5 J3 A1 N2 
L2 —19.7* - 
K3 —21.5* —6.1* - 
F4 —12.5 (0.09) —3.9* —0.2 (0.83) - 
17 —26.3 (0.19) —10.2* —3.3* —1.9* - 
B1 —22.8 (0.16) —9.7 (0.82) —3.9* —2.5 —1.0 (0.33) - 
D2 —14.6* -7,* —4.6* —3.7* —2.8* —2.1 (0.07) - 
H6 —38.2 (0.40) —18.9* —9,67* —5.7* —6.3 (0.23) —4.2* —0.2 (0.85) - 
M2 —11.6* —6.4* —4.1* —3.6* —2.8* —2.2 (0.07) —0.5 (0.63) —0.5 (0.66) - 
G5 —15.3* —8.7* —5.7* —4.8 —4.1* —3.4* —1.1 (0.30) —12 (0.26) —0.4 (0.67) - 
J3 —12.7* —7.9* —5.6* —5.0* —4.4* —3.8* —2.0 (0.08) —2.2 (0.07) —1.3 (0.21) —1.1 (0.32) - 
A1 —15.5* —9.9* —7.3* —6.4* —5.9* —5.2* —2.9* —3.5* —2.1 (0.06) —1.9 (0.09) —0.6 (0.55) - 
N2 —18.0 (0.28) —11.6* —8.6* —7.3* —7.0* —6,2* —3.5* —4.4* —2.5* —2.4 (0.04) —1.0 (0.36) —0.3 (0.75) - 
C2 —41.9 (0.29) —27.7* —19.8* —13.5* —17.1 (0.08) —14.4* —7.1* —12.8* —4.9* —5.4* —2.9* —2.4* —2.2 (0.06) 


Note: The numbers are t-values from t-tests; a positive number means that the percentages mentioned in the first column is larger than in the first row, and vice versa. *statistically relevant for p < 
0.05; p is noted between brackets when not statistically relevant. 
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Table 4. Performance ranking of masks based on comparison of mean mist percentage for in front and on side series. 


In front On side 

rank masks % mist masks % mist 
none 6.4 

1 E3 3.9 E3 3.8 

2 F4 and L2 8.4-9.7 L2 10.4 

3 A1, B1 and D2 10.5-10.8 K3 and F4 13.3-13.5 

4 K3 13.2 I7 and B1 15.1-15.7 

5 H6, J3 and 17 14.3-15.6 D2, H6, M2 and G5 18.0-19.5 

6 N2 and G5 16.0-16.4 J3 and A1 21.2 - 22.4 

7 C2 and M2 20.0 C2 and N2 22.9-25.4 

none 36.7 


Note: none, test without mask, was not included in the ranking. 


Table 5. Univariate analysis of top half ranking and mask characteristics (on the side). 


Mask characteristic Top half n/N Bottom half n/N Exp(B) (95% CI) p-value 
Fenders vs no 1/6 3/8 0.33 (0.02-4.40) 0.404 
Nose piece vs none 4/6 5/8 1.20 (0.13-11.05) 0.872 
Layers two or less vs more than two 1/6 4/8 0.20 (0.02-2.57) 0.217 
Filter vs no filter 2/6 5/8 3.33 (0.36-30.70) 0.288 
Woven vs non-woven 3/6 5/8 0.60 (0.07-5.13) 0.641 
Height above 14 cm vs smaller 6/6 4/8 - 0.999 
Width above 20 cm vs smaller 6/6 4/8 - 0.999 
Loose fit vs tight fit 1/6 6/8 0.06 (0.005-0.97) 0.047 


p is bold means statistically relevant difference for p < 0.05. 


SWiFt guidelines from Ireland (SWiFT 2020), claim that to ensure an optimal fit, visual fit tests should be 
conducted on a range of users (head size or age). Additionally, they encourage user tests to be conducted, in 
which the following attributes should be covered to have the best fit over time: elastic and head harness ade- 
quate length and materials, strong attachment of head harness parts, comfortable seams, and stitching across 
nose and sides, comfortable nose piece, breathing comfort and moisture issues. 

In terms of visual inspections, standardization guidelines across different countries (AFNOR 2020; NEN 
2020; CEN 2020) suggest that manufacturers carry out a visual inspection of masks to ensure their compli- 
ance. These inspections need to ensure that the materials present no defects, such as tears, detachments, 
looser fit, deformation, or wear of materials. It is also recommended that, in the case of reusable masks, con- 
sumers conduct the same inspection after each wash. 

More recently, the ASTM has published a face mask covering standard, which specifies a standardized 
method and performance criteria in terms of the breathability, leakage around the edges, and reusability 
of face masks (ASTM-2021). 


Qualitative comparison 


Patterns and mist distribution 
From the coloured patterns and the mean images presented in Figures 8 and 9, respectively, a qualitative 
assessment was performed. 

Figure 8 shows that the test with mask E3 did not produce a lot of mist in both the front and the side test. 
The second best was mask L2, showing mainly mist above the mannikin head. Colouring inside these two 
masks at the start (see Figure 8) was mostly focused on the nostrils area and not in the entire mask, but at the 
end of the tests, the colouring patterns increased inside the mask and the coloured mist went through the 
outer layers in both of them. 

Compared to masks E3 and L2, masks D2, F4, K3, B1, and Al produced more mist in the environment 
from two sides (see Figure 10) and their amount of mist production is like each other. Colouring inside these 
masks F4, K3, B1, and Alat the start was not only focused on the nostrils part (part 2 based on Figure 8) but 
also spread inside them. In the end, the colouring patterns were completely scattered. Colouring inside mask 
D2 differed most, it started in section 2 and at the end, the colouring didn’t spread but dripped down. 

For Figure 10, masks C2, G5, H6, N2, M2, I7, and J3 produced high amounts of mist on the sides and 
showed the most leakage. Additionally, based on Figure 8, the distribution of the coloured mist inside these 
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masks was different. At the start, colouring inside masks G5 and H6 was scattered, as opposed to the colour- 
ing in masks C2, M2, I7, N2 and J3, which was focused on the nostrils area. At the end, colouring patterns 
were scattered in masks G5, H6 (from part 1-9) and I7 but in masks C2, N2, M2 and J3 colouring was mostly 
seen in the middle. Moreover, the coloured mist went through the outer layers of masks C2, G5, N2, M2 
and J3. 


Outward leakage and design of masks 

In terms of qualitative observations, outward leakage through the face seal perimeter seems to be highly 
dependent on the fit of the mask around the nose of the manikin (achieved by a nose piece), and by the 
fit against the cheeks of the manikin, achieved by several characteristics, including, the size of the mask 
and its shape (flat, sewn) (Figure 8). A poor nose fit will eject mist upwards while a poor cheek fit will 
do so from the side. However, such characteristics are not essential in masks, for example, L2 and E3 are 
two of the best performers, yet do not present any nose pieces. The number of layers seems to play a greater 
role in the leakage, masks with fewer than two layers perform worse, as can be seen with the results of C2; 
M2; N2; and J3. Finally, masks with a central seam, as opposed to a single flat sheet, seem to provide a better 
fit around the face of a wearer. 

Furthermore, outward leakage also depended on the material of the mask. Generally, woven materials 
allowed the mist to go through the material, while non-woven ones did not. This was seen in the masks 
C2 and M2, two of the worst performers, since they present an elastic material whose threads stretch 
when worn. Additionally, filters used in the masks of this study were always made of non-woven materials 
(KN95 or PM) 5); therefore, filters should be a good addition to any mask, as seen with L2, a regular mask 
which performance seems to improve considerably due to the presence of the filter. 

Currently, most standardization guidelines do not present outward leakage or fitting testing of masks. 
Most guidelines focus the performance suggestions on tests related to head harness stress tests (up to 
five times donning and doffing), filtering efficacy tests (following in their turn specific guidelines), and 
breathing resistance and air permeability test (to determine differential pressure and constant flow) 
(CEN 2020). 

Therefore, the inclusion of perimeter seal fit testing could be advantageous to further ensure the optimal 
performance of face masks for the public. Such testing could be limited to the observation of leakage 
through the nose bridge, cheeks, and chin with different head shapes, and sizes, to offer the better suiting 
mask to consumers. 


Strength and limitations 


Although the fit of a mask is considered to be an important feature of the mask to prevent outward leakage, 
no test yet has been recommended for this. The study presented in this article is a first attempt to provide a 
way of assessing masks on their outward leakage with the presented methodology, which could be con- 
sidered a strength. 

In this particular test, qualitative and quantitative assessments were used. This mixed-method analysis 
proves to be particularly useful in this study because they complement each other: the quantitative test 
was limited to two-dimensional footage of the front and side of a breathing manikin. Therefore, combining 
it with the qualitative observations of the patterns of mist along with the patterns on the inside of the mask, 
provide a more complete evaluation as from which routes (chin, nose, cheeks, or through material) the 
water mist escapes through the gaps of the face seal perimeter. 

Tests were performed for two minutes to stabilize the production of mist while avoiding the conden- 
sation of mist inside the mask or the air tubes, which could be the case if the mist runs for longer periods. 

One limitation mist leaking through the material of the mask itself, rather than around the face seal per- 
imeter, was also visible with the technique used, both in the front and the side footage. However, it is not 
easy to distinguish how much of the mist was leaking through the material or around the face seal perimeter. 

Another limitation of the present experiment is that the tests recorded from the front were performed on 
the same day, while those from the side were performed a week apart. The mist production rate of the fog- 
ging machine was not known. However, it is possible that discrepancies in the production changed from one 
use to the other. 

Additionally, the fluorescent liquid used in this experiment does not have the same viscoelastic proper- 
ties that expelled aerosol droplets have, which may change the amount of escaped mist. The amount of 
leaked mist may also be influenced by the laboratory settings of temperature of humidity, which were 
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kept constant in the experiments of this study, however, further studies may be conducted with variations of 
humidity and temperature. 

Furthermore, the data gathered is a two-dimensional representation of the mist in space. As a result, a 
missing element of the data is the concentration of that mist: some areas of mist may be of higher concen- 
tration than others. 

Additionally, a further element that should be evaluated is the performance of masks over time. Although 
in the present study masks were used for four tests of two minutes each, and also for some extra tests in case 
of repetitions, they were not used for long enough, considering what several manufacturers claim their 
masks to be useful for. Homemade masks or non-filtered, layered, woven masks that tend to only absorb 
the mist (i.e. E3) may soak after a few hours of use. 

Moreover, only one head type of Styrofoam material was used to test the masks. However, the market for 
face masks is universal and should thus be tested with different sizes and shapes of heads, representing 
different genders, ethnicities, and ages. 

Finally, tests of actual comfort and ergonomics with real people should be performed, in order to com- 
pare results of the present tests with the preferences of different types of wearers, with glasses, smaller heads, 
etc. to assess not only the fit but comfort, breathability, and usability. 


Conclusions 


From the study presented here can be concluded that the use of mixed methods to assess the fit of the mask 
by visualizing the breath of a human with coloured water mist could be an adequate solution to incorporate 
as part of the testing and assessment of masks in guidelines for standardization. 

Qualitative and quantitative methods complement each other: on the one hand, quantitative visualiza- 
tion of mist allows to measure the leaked amount of mist in a two-dimensional manner, both in terms of 
patterns created within the space around the wearer but also in terms of routes of escape. While the quan- 
titative analysis complements the routes of escape of mist by inspecting the actual possible gaps in the face 
seal perimeter between the mask and the skin. 

The results of the fourteen masks tested showed that tighter-fitting masks seem to perform better than 
loose ones. Tight-fitting masks can be achieved with the right size, shape, or nose clip. In the present study, 
only one head size was used, however, further studies are needed to generate a better fitting assessment. 
Nevertheless, the use of face masks, whatever their characteristics, seem an adequate strategy to reduce 
the amount dispersion of potential ‘infected’ aerosols into the space from people, as opposed to not wearing 
one. However, this dispersion while wearing a mask, is partly redistributing these exhaled aerosols into the 
space, mainly sideways, upwards, and downwards. These should be dealt with through appropriate venti- 
lation strategies. 
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